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ABSTRACT 

This report describes a study conducted to determine if there 
were any applicable effects from private-school competition on public-school 
student achievement in North Carolina. The study examined multiple student 
outcomes, including elementary and secondary student achievement results, 
student dropout rates, and high school student achievement results analyzed 
by ethnicity. The data were aggregated at three levels (district, county, and 
unified county) to account for educational market particulars and competition 
between school districts in those areas where additional public-school choice 
was available. The study found no indication of significant private-school 
competition effects for North Carolina public-school outcomes. Following an 
introduction, the report provides a brief review of previous research. The 
next section discusses the role of competition and provides two possible 
mechanisms through which private-school competition might influence public- 
school behavior. Subsequent sections highlight the basic empirical issues 
involved in empirical estimations of private-school competition on public- 
school outcomes; explain the particular methodology and model used in the 
study; discuss' the data; analyze the results; and discuss the implications of 
the findings as well as the limitation of the study for the larger body of 
research. (Contains 121 references.) (WFA) 
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I. Introduction 

The recent U.S. Supreme Court ruling in Zelman v. Simmons-Harris (2002) has once 
again placed school choice at the center of America’s policy agenda. As a result of the 
ruling, vouchers and private schools have become the focus of research, and are viewed 
as possible instruments to help improve the quality of American education. Private 
schools are again being evaluated not only for any differential value they may add to the 
production of a student’s education, but also for the effect increased levels of competition 
exercises on the educational environment and attainment of students generally. 

The purpose of this study is to determine if there are any appreciable effects from private 
school competition on public school student achievement in North Carolina. The study 
utilizes a specific methodology popularized by Hoxby (1994®), and seeks to discover if 
the private school competition effects found by Couch, Shughart and Williams (1993) 
and Newmark (1995), can be duplicated when analyzing another cross-section of data 
(the 1998-1999 academic year) and incorporating the new methodology. The new 
methodological approach allows for a novel way to control for the simultaneity that exists 
between private school enrollment and public school outcomes. In keeping with the spirit 
of the Couch et al study no student sorting and selection choice model will be employed. 

This study extends Couch et al’s research in several other areas. First, multiple student 
outcomes are examined, including elementary as well as secondary student achievement 
results, and student dropout rates. Second, high school student achievement results are 
analyzed by ethnicity. Finally, the data is aggregated at three levels (district, county and 
“unified” county) to account for educational market particulars and competition between 
school districts in those areas where additional public school choice is available. While 
finding some evidence of trends found in previous research, there is no indication of 
significant private school competition effects for North Carolina public school outcomes 
in this data set. 
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The study is composed of nine sections: Section II provides a brief review of the private 
school competition empirical research; Section HI discusses the unique public goods 
nature of education, the role of competition and provides two possible mechanisms 
through which private school competition may influence public school behavior; Section 
rv highlights the basic empirical issues involved in empirical estimation of private school 
competition on public school outcomes; Section V reviews the Couch et al study while 
Section VI explains the particular methodology and model to be employed in this study; 
Section Vlt discusses the data to be evaluated; and Section Vin analyzes the studies 
results. The final section (Section DC) discusses the implications of the findings as well as 
the limitations of this study for the larger body of research. 

II. Review of the Private School Competition Literature 

The current research agenda for the private school education literature was largely set 
with the series of studies James S. Coleman and his fellow researchers authored in the 
1980’s.* Using the High School and Beyond longitudinal study data, Coleman et al found 
that both Catholic and non-Catholic private schools are more effective than public 
schools in assisting students in cognitive skills acquisition. The Coleman series of studies 
furthered the analysis by incorporating a student selection model to account for the type 
of school students choose to attend (see Section IV below for a discussion of sorting and 
selection). 

The Coleman studies ignited a series of responses and re-analyses of the High School and 
Beyond data. Most notable among these studies was Noell’s (1982), which found that 
after including additional explanatory variables,^ private school students failed to produce 
significant gains in cognitive ability acquisition for seniors as measured in reading and 
mathematics performance (Noell 1982, pp. 131-132). Noell’s contention was that the 
Coleman studies mistakenly overstated the impact of private schools by neglecting to 

' See: Coleman 1982; Coleman and Hoffer 1983 & 1987; Coleman, Hoffer and Kilgore 1981, 1982“, 1982'’ 
& 1982”; and Hoffer, Greeley and Coleman 1985. 

^ See: Alexander and Pallas 1982, 1983 & 1985; Cain and Goldberger 1983; Jencks 1985; Mumane 1984; 
Mumane et al 1985; Noell 1982 & 1983; Willms 1985; and Witte 1992. 

^ Additional predictors included: sex, handicap status, region of residence, and eighth grade college 
attendance expectations (Noell 1982, pp. 125-127). 
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account for the additional explanatory variables, factors that would determine a student’s 
self-selection into Catholic and other private schools and thereby account for the increase 
in student performance (Noell 1982, p. 125). 

Mumane et al (1985) demonstrated a critical point in the literature as a result of the 
Coleman and Noell investigations: accounting for student selection is critical and can 
dramatically affect findings. Mumane et al showed that the difference in findings 
between Coleman and Noell lies in the researchers use of different models to account for 
selection (Mumane et al 1985, p. 26). 

Towards the late 1980’s the literature began to subtly change emphasis, and began to 
focus on the institutional stmcture of public and private schools. Chubb and Moe (1988 
& 1990) argued that private schools possess characteristics that allow for greater 
organizational and administrative flexibility due in large part to their political and 
bureaucratic autonomy, allowing private school students to out perform their public 
school counterparts. The Chubb and Moe studies expanded the Coleman investigations, 
utilizing the High School and Beyond data, and have reintroduced public finance and 
public goods issues into the private school discussion, as a well as maintaining that 
competition in education markets has beneficial effects for students generally by 
promoting greater student productivity (increased student achievement) and greater 
resource efficiency (greater student productivity for dollar spent). 

Another shift in emphasis arose in the early 1990’s when some researchers began to 
utilize more simplistic models and specifications to estimate the effect of private school 
competition. These studies, while acknowledging the Coleman literature, began to depart 
fi-om many of the specific theoretical and methodological discussions at issue in that 
literature. Specifically, many of these studies did not incorporate any formal student 
selection model, the most significant issue governing the Coleman literature, and instead 
focused their attention on another issue: modeling the simultaneous nature of private 
school enrollment with public school quality (ex: Borland and Howsen 1992; Couch, 
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Shughart and Williams 1993; Dee 1998; Hoxby 1994^; Newmark 1995; Simon and 
Lovrich 1996; and Sander 1999). 

Again, the empirical results demonstrated a mixed pattern with several studies finding 
positive effects fi'om private school competition (Borland and Howsen 1992; Couch, 
Shughart and Williams 1993; Dee 1998; Hoxby 1994®), while several found no 
significant effects, mixed effects, or even negative impacts fi'om competition (Newmark 
1995; Simon and Lovrich 1996; and Sander 1999). 

Ironically, the most recent studies, begirming in the mid 1990’s and running through the 
present, have returned to the issues and agenda outlined by the Coleman literature in a 
more direct fashion. These studies emphasize both a concentration on issues of student 
selection as well as accounting for issues of simultaneity, and have developed some 
particularly elaborate models (ex: Figlio and Stone 1999; and Goldhaber 1996). Again, 
the findings have been mixed, especially with regards to the effect private school 
competition exercises on public school student test scores."* 

However, this most recent set of studies has expanded the analysis by examining several 
other measures of student performance including: high school graduation/dropout rates, 
the probability of college entrance, average wage rates, etc. Studies using these public 
school student outcomes have found a more consistent patterns of positive impacts on 
student performance resulting fi'om private school competition, especially with regards to 
reducing public high school dropout rates and increasing the probability of public school 
students attending college (ex: Altonji, Elder and Taber 2000; Evans and Schwab 1995; 
Neal 1997 & 2000; Sander 1996 & 1997; and Sander and Krautman 1995). 

III. Competition as a Mechanism for Improving Student Performance 

One aspect that marks the private school competition research, and the school choice 
literature generally, is the contention that education is a unique good, and therefore does 
not respond to the incentive structure generated by a market environment (see Stiglitz 

'* See Hoxby (1998) and Neal (1998) for literature overviews for this later period. 
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2000®, pp. 434-435 for an overview of the arguments). This section provides a brief 
sketch of two of the most important elements of these arguments, the public goods status 
of education and the role of competition, while providing two possible mechanisms 
private school competition may operate through to impact public school behavior. 

Education as a Public Good 

Education is generally considered to be an “impure” or “mixed” public good^: education 
can be produced like other private goods without generating externalities, or spillover 
effects, although the consumption of education by individuals generates externalities that 
accrue not only to the individual but to society at large (Buchanan 1968; Stiglitz 1974 & 
2000 ®). 

Examples of such externalities in consumption include increases in social capital (ex: a 
better educated populace; adherence to a common set of values and norms; and 
socialization of diverse ethnic populations generally), increases in human capital (ex: 
direct benefits to families and individuals that invest and consume education in terms 
increased expected future income, and increased productivity, technology and economic 
growth generally), and may also have negative impacts on social and human capital (ex: 
increase ethnic stratification; parents making sub-optimal investments in education for 
their children because of lack of resources, knowledge or interest; or other distributional 
inequities). 

These consumption externalities, particularly the distributional concerns, are the primary 
reason for public provision of education (on these points see: Becker 1993; Buchanan 
1968; Dee 2003; Friedman 1955; Gradstein and Justman 2000; Hanushek 2002; Lott 
1 990 & 1 999; Machlup 1 970; Stiglitz 2000; and West 1 965).^ 



^ A “pure public good” is defined as possessing two characteristics: (1) the marginal cost of an additional 
person consuming it is zero; and (2) the cost of excluding an individual is infinite (prohibitive), the non- 
exclusivity principle (Buchanan 1968, p. 36; and Stiglitz 1974, p. 350). 

^ Gradstein and Justman (2000) argue that these arguments do not necessarily imply public provision as 
much as they imply public financing, and leave open the question of provision and institutional structure. 
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Competition as a Discovery Procedure 

In light of the preceding discussion, that education is indeed a unique good, specifically 
an impure public good, requiring at minimum public financing if not complete public 
provision to overcome the externalities generated in consumption, how then can markets 
and competition improve educational outcomes? The answer lies in an understanding of 
the competitive process. 



Hayek (1945) has argued that the fundamental problem of economics is not just one of 
distributional concerns in terms of resource allocation, but “is a problem of the utilization 
of knowledge which is not given to anyone in its totality” (Hayek 1945, p. 78), and that 
“it is only through the process of competition that the facts will be discovered” (Hayek 
1946, p. 96). 

Further, Hayek maintained that the market, like language and law, is an example of a 
spontaneous order, the result of human interactions and not of any conscious human 
design. The price system is really nothing more than a communication system: “The most 
significant fact about this [price] system is the economy of knowledge with which it 
operates, or how little the individual participants need to know in order to be able to take 
the right action” (Hayek 1945, p. 86). Certain aspects of modem neoclassical competitive 
analysis have incorporated elements of Hayek’ s argument, in particular the idea of prices 
as “aggregators of information” (Grossman and Stiglitz 1976, p. 252).’ 

Competition is essentially a discovery procedure, Hayek contends, that allows individuals 
with, in many instances, tacitly held knowledge to achieve and realize those ends they 
seek without being aware of other’s plans or knowledge. In particular, the market and the 
price system help coordinate activity without serving a “given hierarchy of ends” (Hayek 
1968, p. 183). With regards to Hayek’s arguments concerning the price system as a 

’ Grossman and Stiglitz (1976) and Stiglitz (2000*’) contend that Hayek’s explanation of competition, while 
addressing resource scarcity, fails to account for market failures that lead to sub-optimal (in terms of 
realizing Pareto optimal market outcomes) investments in information by market participants, issues that 
result in moral hazard and principal-agent problems. For a critique of the economics of information’s 
appropriation of Hayek’s ideas, especially Grossman and Stiglitz’s synthesis, see Thomsen (1992). For an 
overview of the theories of competition see Vickers (1995). 

O 
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communication system, the greater the degree of competition the greater opportunity for 
informational asymmetries to be solved. 

To the extent that public education encounters principal-agent dilemmas due to 
asymmetries in information, competition viewed in this context may improve the market 
outcomes, by providing more information to consumers (parents and students) about the 
quality of goods (schools and student achievement) in the market. Additionally, greater 
competition should generate financial incentives for schools to be more resource 
efficient, producing better results (presumably increased student achievement) with fewer 
resources (dollars and/or students). 

Two Possible Mechanisms Competition May Influence Public School Behavior 
The theoretical mechanism by which private schools may exercise some degree of 
influence over public school behavior are of two types; (a) where school administrators 
respond to competitive pressures from private schools in the form of financial incentives 
(losing students to private institutions and therefore losing student funds) by adjusting 
their behavior (retaining only “effective,” well educated teachers, minimizing costs, 
increasing student achievement, etc.); or (b), through student sorting/selection between 
institutions along any of several lines (academic, behavioral, socioeconomic, etc.). 

Hoxby notes that private school competition makes total public school budgets depend 
positively on public school productivity (better student performance by public schools, 
yields increased student enrollment in public schools, and therefore more total funds). 
However, it is not clear what effect competition will have on public school per-pupil 
budgets. Public per-pupil budgets may actually increase when private school competition 
draws more students away from the pool of public school students, especially if total 
school budgets remain constant (approximately the same amount of funds allocated over 
fewer students). With no fixed costs of providing public schooling, school personnel 
would most likely prefer higher per-pupil budgets regardless of the total school budget 
(Hoxby 1994^ p. 6). 
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To the extent that fixed costs due play a role, the utility of public school personnel may 
fall with the total school budget, irrespective of per-pupil budgets. Therefore, greater 
private school competition will improve the financial incentives faced by public schools 
if per-pupil as well as total public school budgets depend positively on public school 
productivity (better student performance) or if public school personnel are more sensitive 
to total public school budgets. Greater private school competition will worsen financial 
incentives facing public schools if public school personnel are sensitive primarily to per- 
pupil budgets and per-pupil budgets depend negatively on public school productivity 
(Hoxby 1994®, pp. 6-7). State educational agencies (SEAs) and local educational agencies 
(LEAs) can undermine these financial incentives to the degree that they subsidize local 
school’s total and per-pupil budgets when they lose students (Arum 1996 and Hoxby 
2001 ). 



IV. Empirical Issues 

The private school competition literature is confounded by two central empirical issues 
when attempting to estimate competition’s impact on public school student outcomes: 
endogeneity and student sorting and selection. First, public school quality is 
simultaneously determined with private school enrollment: the endogeneity issue. 
Second, the effect of student sorting and selection may be driving the results, which may 
be independent of public school quality. Each of these issues is discussed in turn. 

Endogeneity 

First, endogeneity: demand for private schools is certainly correlated with the quality of 
public schools. This is a consequence of the demand for private school education being 
jointly determined by the quality of local public schools. This issue is known as 
simultaneity, and can be seen from examination of a simple regression equation. 

Suppose we wished to estimate equation (a) below. Using ordinary least squares (OLS) 
we can regress some metric of student achievement, say standardized test scores, onto 
private school enrollment, measures of school demographics (teacher experience, 
education, class size, per pupil expenditures, etc.), student characteristics (race, gender. 
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student ability, etc.), family demographics (family income, parent education, race, etc.), 
and an error term (e). We are interested in the estimated coefficient ^2, the coefficient on 
the private school enrollment variable. However, private school enrollment is certainly 
correlated with the standardized test scores: poor public school quality (low test scores) 
may determine private school enrollment, or private school student enrollment may be 
determining public school test scores by changing student populations (e.g. all of the high 
performing students may enroll in private schools; the so called “cream skimming” 
scenario).* 

STUDENT ACHIEVEMENT = ^1+^2 PRIVATE + jSj SCHOOL DEMOGRAPHICS + 
iS4 STUDENT CHARACTERISTICS + jSj FAMILY DEMOGRAPHICS + e (a) 

Standard OLS assumes that the explanatory variables are independent and exogenous 
relative to the dependent variable and the error term. Although, in this case private school 
enrollment is jointly determined with test scores: this is simultaneity. If this simultaneity 
is not accounted for by using statistical techniques to insulate the explanatory variables, 
the resulting OLS coefficient estimate on private school enrollment (^2) will be biased 
(downwards), understating the effect of competition on public school student 
achievement. 

In order to obtain unbiased estimates of the private school competition effect a 
private school participation equation can be specified. Equation (b) specifies the 
determinates of private school enrollment: 

PRIVATE SCHOOL ENROLLMENT = tti + «2 CATHOLIC MEMBERSHIP + 
SCHOOL DEMOGRAPHICS + 04 STUDENT CHARACTERISTICS + 
as FAMILY DEMOGRAPHICS + v (b) 



* There are several theoretical accounts establishing that increased stratification and “cream skimming” will 
result when consiuners are faced with increased school choice, especially vouchers (see Epple and Romano 
1998 and Stiglitz 1974). However, the empirical literature has shown inconsistent and contradictory results, 
yielding support for both positive and negative student sorting and selection (Arum 1996; Epple and 
Romano 2002; Evans and Schwab 1995; Figlio and Ludwig 2000; Figlio and Stone 1999; Goldhaber 1996; 
Hanushek 2002; Hoxby 2001; Ladd and Fiske 2000; Ladd and Fiske 2001; Neal 1997; and Witte 1992). 
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What is required is an instrument that accounts for private school enrollment, but is 
unrelated to the unobserved determinants (the error term in equation (a), e) of public 
school quality. This instrument can then yield unbiased estimates of 02- Once a reliable 
instrument is found for private school competition, like Catholic membership, then 
alternative estimations techniques can be utilized. Techniques such as instrumental 
variables (IV) which allow the researcher to estimate a two-equation system, like 
equations (a) and (b) above, while controlling for the simultaneity between private school 
enrollment and public school test scores, yielding unbiased estimates of 02 - 

Student Sorting and Selection 

A second effect, associated with issues of simultaneity, is student sorting and selection. 
Some authors consider this issue to be the most important and most difficult issue to 
surmount when trying to empirically estimate differences between public and private 
schools (see: Evans and Schwab 1995, p. 961; and Hanushek 2002, p. 72). 

Student sorting is the result of decisions parents and students make regarding the type of 
school they attend. Technically, sorting is one aspect of selection (self selection): sorting 
is the economic description of an individual’s decisions to attend certain institutions, and 
not others. At least four types of sorting can be identified: (a) along ability lines (most or 
least able children tend to enroll in private schools); (b) along personality lines (most 
disruptive students tend to enroll in private schools or vice versa); (c), along taste lines 
(parents may choose private schools for non-traditional curricula, for moral/religious 
preferences, etc.); or (d) along socioeconomic lines (sorting may lead to economic/racial 
stratification) (see Hoxby 1994^ pp. 7-8). 

Sorting may influence public school outcomes directly through changes in parent and 
student populations, or may affect them indirectly via peer effects and teacher heuristics 
tailored to their student’s needs. Sorting may increase the variation of student outcomes 
by transforming peer effects (reducing interactions between more able students on less 
able students and vice versa), or it may decrease variation in student outcomes when 
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teacher techniques become tailored to each student (thereby equalizing outcomes across 
abilities)(Hoxby 1994^ p. 31). For instance, in a recent study examining student-level 
data from both public and private schools across five countries (Belgium, France, New 
Zealand, Ontario, and the United States), researchers found that raising the average peer 
level increases individual student achievement across all school types and countries, 
particularly for lower-performing students (Zimmer and Toma 2000, pp. 88-89).^ 



Selection is closely related to student sorting, in that selection is concerned with the 
effects of student populations on outcomes. Formally, selection bias occurs when a model 
is estimated, as equation (a) above, over a non-random sub-sample of the larger 
population, with researchers then seeking to determine behavioral relationships for the 
larger population (see: Heckman 1979; and Kennedy 1998, pp. 251-252). Two processes 
may generate such results: (i) self selection (sorting, discussed above) by the individuals 
under investigation; or (ii), decisions by the researcher in composing the sample 
(Heckman 1979, p. 153). 



For instance, suppose we estimate equation (a) only using test scores for high performing 
(or only low performing) public school students, and then wish to make generalized 
inferences about the total public school student population. Clearly, high performing (low 



^ Peer group effects and their impact on student achievement is an unsettled question in the literature. 

Oakes (1985) now classic statement that ability tracking (grouping classrooms homogeneously by ability 
level) of students perpetuates achievement inequities between ethnic and socioeconomic groups is the 
standard position (see also Oakes 1990 & 1992). Empirical estimation of peer group effects are confounded 
by omission of relevant variables, the endogenous nature of school choice, and the ability of schools to 
“informally” track students (see: Betts and Shkolnik 2000*^; Evans, Oates and Schwab 1992; Figlio 2002; 
Hanushek et al 2000; Rees et al 2000; and Rivkin 2001). Argys et al (1996) find that abolition of public 
school tracking would yield large and positive inpacts on achievement for students in lower tracks, at the 
expense of public school students in the upper-tracks. Hoxby (2000^) find positive impacts from 
heterogeneous peer effects, but also finds evidence that peer effects are stronger intra-race, and that some 
effects do not work through achievement. For instance, Hoxby finds that females in the classroom has a 
positive effect on male math scores “that could not come through females’ effect on mean peer 
achievement in math” (Hoxby 2000^, p. 36). Zimmer (2003) finds that tracking reduces positive peer 
effects on low- to average-ability students, while having no measurable effect on high-ability students. In 
contrast, Epple and Romano (1998), Epple et al (2002) and Caucutt (2002), while finding slight evidence of 
achievement gains/losses from peer effects and tracking, argue the largest inpact of tracking is its re- 
distributional effect from lower- to higher-ability students in public schools, especially in the presence of 
school choice and voucher programs. After controlling for endogeneity, Figlio (2002) finds that public 
school tracking does improve student performance for lower-achieving students when you compare not just 
tracked and non-tracked students, but compare students of similar achievement levels within the same 
school (Figlio 2002, p.513). 
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performing) public school students are not representative of the entire student population. 
The estimated coefficients would be biased, overstating (understating) the effect of 
private school competition. In this sense selection can be viewed as determining the 
sample of student outcomes (e.g. standardized test scores) we observe as dependent 
variables. 

Generally, selection bias is assumed to overstate the private school competition effect. 

As with sorting, the direction of the bias is unclear since multiple effects can work in 
opposing directions. In contrast to issues of positive selection (e.g. “cream skimming,” 
overstating the estimated effect of private school competition), is the contention that 
certain private schools (generally Catholic/religious schools) experience negative 
selection. In the case of negative selection private schools may become repositories for 
behavioral and/or ability challenged students (see: Evans and Schwab 1995, p. 970; 

Figlio & Ludwig 2000, pp. 24-25; and Neal 1997, p. 115 note # 20).'° The estimated 
coefficient ( 182 ) will understate the competition effect in this case. Considerations such as 
these render ex ante predictions of the effect of student sorting and selection inconclusive 
(Mumane et al 1985, p. 24). 

Most studies attempt to address these issues empirically by estimating a two equation, 
reduced form model, where the equation of interest is some education production 
function, and the secondary equation is some demand for private school 
enrollment/education. To solve the endogeneity issue several studies have employed an 
instrumental variables approach, and use Catholic concentration/population to instrument 
for private school student enrollment, since Catholics are highly correlated with private 
school provision (approximately 65 percent of U.S. private school students attend a 
school affiliated with the Catholic Church; Hoxby 1998, p. 50) but uncorrelated with 
demand for private school education that is the result of poor public school quality (Dee 
1998; Evans and Schwab 1995; Hoxby 1994®; Neal 1997, 1998 and 2000; Sander 1999). 



Student selection and the direction of the bias is hotly contested within the literature. Some researchers 
find little evidence of positive selection (Hoxby 1994^ 1998 and 2001; Neal 1997 and Sander 1996), while 
others maintain that there is strong evidence, particularly in systems that have extensive choice programs 
(see Ladd and Fiske 2000 & 2001 for evidence from New Zealand). 
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Still other researchers have used instruments such as market concentration ratios 
(Herfindahl indexes), borrowing fi*om the industrial organization literature in economics, 
to address issues of simultaneity and have arrived at very similar results: increased 
standardized test scores for public school students when market concentration falls; 
increased wage rates for public school teachers in less monopsonistic labor markets; etc. 
(see Borland and Howsen 1992, 1993 and 2000). 

More recently, some researchers have argued that Catholic membership is a poor 
instrument because it fails many simple tests of exogeneity. These researchers contend 
that religious affiliation should be included as an explanatory variable in both the school 
outcomes (a) and private school participation (b) equations (Altonji et al 2002; Figlio and 
Stone 1999; and Kane 1996). These issues will be addressed in the discussion of the 
results below (Section Vm). This current study is an attempt to replicate those studies 
using Catholic membership as an instrument using North Carolina data. 

V. Review of the Couch, Shughart and Williams Study 

The original Couch et al paper has generated a considerable body of literature in its own 
right. While the results are similar to other studies that find beneficial effects fi*om private 
school competition on public school student achievement, the econometric issues raised 
by this study have been extremely contentious. This study provides an excellent template 
fi*om which to illustrate the pitfalls this literature is fi*aught with. Further, the Couch et al 
study will act as a “benchmark” for the current analysis: once issues of simultaneity have 
been accounted for, can we still find significant private school competition effects in 
another cross section of North Carolina data? 

The Couch et al literature demonstrates two important elements. First, simultaneity must 
be accounted for in an attempt to estimate private school competition effects on public 
school student achievement. Second, when modeling private school competition, the need 
to control for student sorting and selection is of paramount concern. 
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Couch, Shughart and Williams 

Couch et al analyze North Carolina data for the 1988-1989 academic year with end-of- 
course (EOC) Algebra I exam scores as their metric of public school student 
achievement. The authors control for race, the education level of the parent’s, poverty 
rate, county population density, and total per pupil expenditures. They find that the 
estimated coefficient on private school enrollment exhibits a significant effect on public 
school test scores: test scores increased by 0.08 (t-statistic = 2.23) standard deviation 
points above the statewide mean (Couch et al 1993, p. 308). 

Couch et al address both the simultaneity and selection issues, but fail to control for 
either. First, the authors attempt to address student sorting and selection by declaring that 
the direction of causality in equation (ii, see note #11 below) runs only fi-om private 
school enrollment to public school test scores. Couch et al assume that it would not be the 
case that low performing public school students would “seek less stringent educational 
standards” in private schools (Couch et al 1993, p. 306). The implication is that all 
private schools have higher academic standards than public schools, which is not the 
case, and that any finding of significant positive estimated competition effects on public 
school test performance are not due to lower performing public school students leaving 
public schools. 

The second stipulation asserts that the two equations," one for private school 
participation and one for public school outcomes, are recursive. Recursive systems 
require the endogenous variables to be unidirectional in their dependency. The authors 
are claiming that private school enrollment determines public school test scores, with no 

“ Couch et al’s two equation model is represented by a private school participation equation (Couch et al 
1993 , pp. 304-305 & 307 ): 

PRIVATE ENROLLMENT = 0:1-1-02 PERCENT BLACK -1- 03 PERCENT COLLEGE EDUCATED -1- 04 
TOTAL FUNDING PER STUDENT -1- Oj PERCENT BELOW POVERTY -1- Og PER CAPITA 
INCOMEi987 + CL 7 POPULATION DENSITY -1- e (i) 

And the public school student outcome equation is represented by: 

ALGEBRAl SCORE = 0 i +02 PERCENT BLACK -1- ft PERCENT PRIVATE SCHOOL STUDENT -1- ft 
TOTAL FUNDING PER STUDENT -1- ft PERCENT BELOW POVERTY -1- ft PERCENT PARENTS 
w/LESS THAN HIGH SCHOOL EDUCATION -1- ft POPULATION DENSITY -1- u (ii) 
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possibility that the opposite may be true. Couch et al have simply assumed the 
simultaneity issue away. As was discussed above in Section IV, it is precisely this 
simultaneous nature between private school enrollment and public school outcomes that 
confounds empirical estimates (see Borland and Howsen 1996). 

VI. Methodology and Model 

The current study utilizes a two-equation reduced- form model, incorporating an 
instrumental variables (IV) approach similar to that employed by Hoxby (1994®). The 
model is: 



STUDENT ACHIEVEMENTij = /3, Xy + ^2 Sy + ft Py + ftPy + 6i (1 ) 

Where public school student achievement is measured by standardized test scores or 
student dropout rates, X is a vector of county level demographics (race, per capita 
income, unemployment rates, population density, labor participation rate, etc.), S is a 
vector of school district/county level characteristics (teacher experience, teacher 
education, per pupil expenditures, etc.), p is a vector of student peer characteristics 
(which only includes race), P represents the private school competition effect (county 
level private school enrollment), and e is an error term for the i'^ county and the school 
district. 

As discussed previously, when trying to estimate the possible impact from private school 
competition on public school outcomes, determination of causality is confounded by 
simultaneity: private school enrollment is endogenously determined with public school 
quality. In order to avoid such confounding effects I will estimate a reduced form demand 
for private school education model represented by: 

PRIVATE SCHOOL ENROLLMENTj = /3i Xy + ft Rj + ftSy + Ui (2) 



Where X again is a vector of county level demographics as in (1), R is religious 
affiliation by county i, S is a vector of school district/county level characteristics (teacher 
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experience, teacher education, county population density, etc.) as in (1), and u is an error 
term. The estimated coefficient on the private school competition (^4 in equation (1)) in 
ordinary least squares (OLS) would be biased downwards, thereby understating the 
competitive effect if public schools are producing lower quality student achievement. 
Alternatively, if sorting and selection effects dominate then OLS estimates not . 
accounting for such endogeneity may bias the estimates upward, and overstate any effect 
of private school enrollment on public school outcomes. I use county Catholic 
membership as an instrument for private school enrol lm ent. 

VII. Data 

The bulk of the data comes from two main sources: North Carolina Department of Public 
Instruction (NCDPI) and the 2000 U.S. Census, with the data set representing a single 
cross-section for the academic year 1998-1999. Three sets of student outcomes are used 
in the analysis: North Carolina public high school end-of-course (EOC) exams, 
elementary level end-of-grade (EOG) exams (grades 3-8), elementary level writing 
exams (grades 4 & 7), and high school dropout rates. Each is discussed in tiun (see 
Tables I and the Data Appendix for full variable descriptions). 

Before discussing the student outcomes, there are two general notes regarding the data. 
First, the small proportion of Catholics in North Carolina (Wake County (Raleigh, NC) 
which has the largest Catholic concentration in the state, only reports a Catholic 

population of 10.4 percent) may reduce the effectiveness of Catholic membership as an 

1 0 

instrument. Indeed, 10 counties register no official Catholic membership whatsoever. 
However, Sander (1999), using a model similar to the one employed in this study, found 
no effect from private school competition on public school outcomes, even when 
examining data from one of the largest Catholic school systems in the LFnited States 
(Chicago, IL)(Sander 1999, p. 706). 



Eight counties have no church/parish within their borders (Bertie, Camden, Caswell, Gates, Greene, Jones, 
Northampton, and Perquimans), while Currituck County has two chapel missions with no membership figures 
available, and Hyde County falls under the authority of the Outer Banks Catholic Parish, again with no figures 
available. 
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Second, North Carolina not only has 100 unified county-level school districts, but an 
additional 17 independent city school districts as well. To account for the variation in 
school district allocation throughout the state, the analysis has been decomposed into 
three subsets: (i) analysis using all 1 17 North Carolina school districts; (ii) analysis 
conducted at the county level, using only the 100 county districts with the city unit 
districts collapsed; and (iii), analysis examining only the 88 “unified” counties, counties 
that had no independent city school district within them. All variables have been adjusted 
(using weighted means) whenever the sub-samples were either collapsed or expanded. 

Hoxby notes that defining a “local education market” for estimation purposes is critical 
for two reasons. First, if one defines the education market too narrowly (at the district 
level) the estimates run the risk of being biased. In this instance, parents who care more 
about education, and have the resources to act on these commitments, are likely to move 
across market boundaries (in this case, school districts) to get better schooling for their 
children, so estimates may be biased since parents in markets with better schools 
systematically care more (or have the resources to affect change) about education (Hoxby 
1994®, p. 3 note # 4). 

Second, defining the local education market too broadly will miss critical masses of 
religious denominations, which help make Catholic and other religious private schools a 
competitive alternative to public schools (through volunteering in the school, providing 
fimds to subsidize tuitions through endowments, offerings, etc.). In this case Hoxby 
views state level aggregation as too broad and will miss out on the concentrations of 
Catholics throughout a state. She concludes that the county is probably the most “ideal” 
local education market (Hoxby 1994®, p. 3 note # 4). 

Considerations such as these suggest the appropriate level of analysis would involve 
multiple levels of aggregation of the data. This will allow the study to overcome several 
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The counties with their associated city districts are: Buncombe (Asheville City); Cabarrus (Kannapolis City); 
Catawba (Hickory and Newton-Conover Cities); Cleveland (Kings Mountain and Shelby Cities); Columbus (Whiteville 
City); Davidson (Lexington and Thomasville Cities); Halifax (Roanoke Rapids and Weldon Cities); Iredel (Mooresville 
City); Orange (Chapel Hill-Carrboro Cities); Randolph (Asheboro City); Sampson (Clinton City); and Surry (Elkin and 
Mount Airy Cities). 
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of the issues raised by Hoxby as well as capture some of the unique features of the North 
Carolina educational landscape. 



End-of-Course Exams 

The first student outcome examined is the end-of-course (EOC) public high school exams 
(also administered at charter schools, however, all charter school exam data has been 
excluded). The EOC was developed in response to legislation passed by the North 
Carolina General Assembly - the North Carolina Elementary and Secondary Reform Act 
of 1984 (NCDPI 1999, p. 1). The EOC are multiple choice exams, administered in the 
ninth through twelfth grades, and are offered in 10 subject areas.’^ For the 1998-1999 
academic year, approximately 631,481 students exams were administered,’^ from a total 
public school student population of 344,730 (ninth through twelfth grades, including both 
public and charter students).’® 



The EOC utilize a series of score types to allow for a variety of comparisons between 
students and academic years: scale scores, percentiles, and achievement levels. The 
scores reported here are achievement levels, which measure the percent of students taking 
the exam at or above Level HI. The Achievement Levels are standards established by 
North Carolina teachers, approved by the state legislature, and are assessments of how 
well students are expected to perform on the exams. There are four levels reported for 
each exam (Level I to Level IV). Level in is defined by the NCDPI to be those students 
who “demonstrate mastery of the course subject matter and skills and are well prepared 
for more advanced level in the content area” (NCDPI 1999®, p. 2; and Greenbook). 

Across all EOC multiple-choice exams, approximately 52 percent of the state public 
school population performs at Levels HI and IV (NCDPI 1999®, p. 2). 



The subjects are with their original norming year: Algebra I (1987); Algebra II (1988); biology (1987); chemistry 
(1989); Economic, Legal, and Political Systems (ELPS) (1991); English I (1990); geometry (1989); physical science 
(1991); physics (1990); and U.S. history (1988). For the 1998-1999 academic year, English II was the only exam not 
mandated by the state. English II is an on -demand writing assessment exam, and is evaluated independently. 

For the academic year of 1 998-1999, the number of students taking EOC subject exams were: Algebra I (87,404); 
Algebra II (48,956); biology (76,872); chemistry (41 ,261); ELPS (77,740); English I (89,679); geometry (60,764); 
physical science (67,397); physics (1 1,221); and U.S. history (70,187) (NCDPI 1999^). 

See the 1998-1999 North Carolina State Testing Results (Greenbook): 
http://www.ncpublicschools.Org/accountabilitv/testing/reports/green/index.html#99GreenBook, and 
http://www.ncpublicschools.org/fbs/stats/pdf/200Qp 1 .pdf 
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One limitation of using EOC exams as indicators of student achievement is that EOC 
exams are not mandatory for all students in all subject areas, introducing sorting and 
selection by both students and schools. While the No Child Left Behind (NCLB) 
legislation seeks to remedy this in current practice, opportunity for such student sorting 
was available during the 1998-1999 school year. Fortunately, the NCDPI required four 
subjects for all students seeking to graduate from North Carolina high schools in 1998- 
1999: Algebra I; Biology; Economic, Legal, and Political Systems (ELPS); and U.S. 
History (NCDPI 1998). These requirements were effective through the 1999-2000 school 

17 

year. 

End-of-Grade Exams 

Analysis of elementary (grades 3-8) end-of-grade (EOG) exams provide an assessment 
that minimizes student sorting issues (EOG exams are mandatory for all students) and 
provides a check to whether private school competition effects may be age specific, as 
suggested by some researchers (Hoxby 1994 and Sander 1999). For instance, the majority 
of private schools in North Carolina are concentrated at the elementary level. North 
Carolina private school enrollment totaled 84,384 for grades K-12 in 1998-1999 
(excluding charter and home school enrollment). Grades K-8 account for 79.4 percent of 
all private school students (66,989 students), while private high school student enrollment 

1 a 

comprises only 20.6 percent of the total (17,395 students). 

In comparison, total public school enrollment (grades K-12, inclusive of charter schools) 
was 1,295,780, with K-8 grades accounting for 73.4 percent (951,050 students), while 
ninth through twelfth grades accounted for 26.6 percent (344,730 students) of the public 
school total enrollment for 1998-1999.*^ Assuming a uniform distribution of students 

The formal NCDPI graduation requirements for 1998-1999 included 20 units: English (4 units); 
mathematics (3 units), one of which must be Algebra I; social studies (3 units), one of which must be 
government and economics (ELPS), one in U.S. History, and one in world studies; science (3 units) one of 
which must be biology, one physical science, and one in environmental science; heath and physical 
education (1 unit); and other courses which may be “designated by the LEA, which may be imdesignated 
electives or courses designated from the NC Standard Course of Study'^ (NCDPI 1998). 

See: http://www.doa.state.nc.us/dnpe/hhh548.htm 
19 

See: http://www.ncpublicschools.org/fbs/stats/pdf/200Qpl.pdf 
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throughout the thirteen grade levels, one would expect to find approximately 69.2 percent 
of the students in grades K-8, and 30.8 percent in grades ninth through twelfth. Clearly, 
private schools have above and below average enrollments for the two groups 
respectively. 

The concentration of private school students in the elementary grades is even more 
pronounced when considering only grades K-6. In this instance, private school 
enrollment accounts for 64.9 percent (54,766 students), while public and charter schools 
account for 58.0 percent (751,356 students) of total enrollment. This indicates that any 
possible private school competition effects, whether positive or negative, would more 
likely be evidenced in the elementary data and in EOG scores. 

EOG exams are mandated by NCDPI for grades three through eight in two main areas, 
reading and mathematics, while writing is tested in the fourth and seventh grades. These 
exams are required of all students in their respective grades. All three content areas of the 
EOG - reading, math and writing - are used in the analysis. The scores reported here are 
the percent of students taking the exam within the county that scored at or above 
Achievement Level in, just as with the EOC exams (again, charter school students are 
excluded). 

Dropout Rates 

While the original Couch et al studies concentrated exclusively on standardized test 
scores, this study seeks to expand the analysis by examining student outcomes beyond 
standardized test scores, and including public high school dropout rates. In fact, the 
school choice literature has re-ignited the debate regarding the most appropriate and 
efficacious measure of school quality and student achievement. Several researchers argue 
that standardized test scores are a poor barometer of both student achievement and future 
labor market success (Card and Kruger 1992; Card and Krueger 1996; Evans and Schwab 
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1995; Hanushek 2002; and Krueger 1999).^° This theme is both reinforced and echoed by 
several of the recent discussions evaluating the high-stakes accountability systems 
employed by many states (Figlio and Getzler 2002; Hanushek and Raymond 2001; and 
Ladd 2001). 

Several recent studies have found consistent private school competition effects in other 
public school student outcomes, despite not finding simultaneous competition effects in 
standardized test scores. Examples of alternative student outcomes where private school 
competition exercised an appreciable effect include: public high school 
graduation/dropout rates, probability of going on to college, average wage rates, etc. 
(Altonji et al 2000; Dee 1996; Evans and Schwab 1995; Figlio and Stone 1999; Hoxby 
1994^; Mocan et al 2002; Neal 1997, 1998 and 2000; Sander and Krautman 1995). This 
makes evaluation of public school dropout rates an excellent candidate for analysis. 

In the 1998-1999 academic year NCDPI adjusted the ABCs program, the State’s 
accountability program, by redefining the State’s dropout policy. The new policy 
includes students who transfer from high school to community college, students whom 
were previously omitted from the dropout calculus prior to 1998-1999 (NCDPI 2000).^’ 



VII. Results 

The goal and purpose of this study is to determine if any appreciable private school 
competition effects can be evidenced in North Carolina public school data while adapting 
Hoxby’s methodological approach. An extension of this central focus is to use Couch et 
al’s study as a template to further determine if their findings can be duplicated with a 



In contrast, Betts (1995) rejects the Card and Krueger hypothesis that worker earnings are independent of 
which high school they attended, Mumane et al (1995) found that basic cognitive skills acquired by female 
and male high school seniors had a large impact on wages several years out of gradation. 

The formal ABCs definition of dropout rate: The numerator for the ABCs dropout rate is the total 
number of dropouts in grades 9-12 minus the total number of expulsions, long term suspensions, and 
students incarcerated in an adult facility. The ABCs dropout membership is the 20*-day 1998-1999 
membership in grades 9-12, minus the initial enrollees in membership on day 20 in grades 9-12, plus the 
20*-day 1999-2000 membership in grades 9-12, divide the result by two. The ABCs rate is calculated as 
the ABCs dropout numerator multiplied by 100, divided by the sum of the ABCs dropout rate membership 
plus the ABCs dropout numerator. A school had to have membership data for both years to be reported 
(NCDPI 2000). 



O 
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unique data set, using slightly different model specifications, while controling for issues 
of simultaneity. 

This section evaluates the results by dividing the findings into three subsections: (1) a 
discussion of the EOC exams; (2) a discussion of the EOG exams; and (3) a discussion of 
the dropout rate analysis. A final subsection discusses issues pertaining to instrument 
validity. While there is little evidence of any statistically significant impacts from private 
school competition in the data set, several patterns emerge that are both instructive and 
that are found in the larger literature. 

EOC Exams: Analysis of the 1 17 Districts, 100 Counties and 88 “Unified” Districts 
Public school student performance on EOC exams were evaluated in four aspects: (a) 
using the NCDPI generated composite test score (the district average across all 10 subject 
areas); (b) using the four required individual subject area test scores (Algebra I, Biology, 
ELPS, and U.S. History); (c) using an average of the four required subject areas; and (d), 
using a variety of supplementary sensitivity checks. 

Regardless of sub-sample size or dependent variable evaluated (EOC exams composite 
score, the individual subject areas test score, or restricting the dependent variable to the 
average of the four required subjects test scores) private school enrollment failed to 
impact public school test scores (see Tables II-IV). One significant pattern is minority 
public school populations^^ exhibiting consistent downward pressure on the percentage of 
students scoring at or above grade level, a trend consistent with the larger literature’s 
findings. 

In Tables II through V the first stage Catholic membership estimates from the private 
school participation equation are provided. This is one ad hoc way to evaluate the 
adequacy of the instrument. Estimates should indicate a significant and positive 
relationship between Catholic membership and private school enrollment if the 



Minority = the percentage of African American, American Indian, Asian, and Hispanic public school 
students within the district. 
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hypothesized relationship is indeed correct. Notice that while the Catholic membership 
estimated coefficient (located at the bottom of each table) is “right-signed,” that is, 
exhibiting a positive relationship to private school enrollment, it is uniformly 
insignificant. 



Additional sensitivity tests provided several trends observed in previous studies with 
regards to public student ethnicity.^^ While specifications involving only white public 
school students had little effect, those specifications involving only Afiican American 
students produced some interesting trends, albeit, insignificant ones. Irrespective of sub- 
sample size (117, 100 or 88 districts/counties) and regardless of the test score examined^'* 
Afiican American students experienced significant reductions in the size of the standard 
errors (White/robust standard errors to account for the possible heteroskedasticity across 
school districts) for both the private school enrollment and Catholic membership 
coefficients. The results are not reproduced here since the estimates are insignificant at 
conventional levels. However, the pattern is worth noting since several researchers have 
found significant and beneficial private school effects for minority, particularly Afiican 
American students, even in the absence of finding beneficial effects for the larger student 
population (Dee 1998; Evans and Schwab 1995; Neal 1997 and 1998).^^ 



EOG Exams: Analysis of the 117 Districts, 100 Counties and 88 “Unified” Districts 
The evaluation of EOG exams utilizes the entire battery of tests administered to public 
school elementary students: reading, grades 3 through 8; mathematics, grades 3 through 
8; and writing exams administered at grades 4 and 7. Each content area is evaluated 
individually for each grade level. Unlike the EOC analysis, grade levels and content areas 
are not combined to transform the dependent variable. Additionally, EOG exams are not 



^ Additional specifications include: dependent variables group by subject area (“sciences” = biology and 
Algebra I; and “social sciences” = ELPS and U.S. History); substituting either charter or home school 
enrollment for private school enrollment (no change in other covariates); composition of a “competition” 
variable (private + charter school enrollment for 1 17 districts, otherwise private + charter + home school 
enrollment for 100 and 88 county specifications) in place of private school enrollment; and finally 
evaluation of student achievement by ethnicity (white or African American), discussed in text above. 

EOC exams used include: four required subjects averaged (Algebra I, Biology, ELPS, and U.S. History); 
average of the “sciences” (Algebra I and Biology); average of the “social” sciences (ELPS and U.S. 
History); and each of the four required subject areas individually. 

^ These trends and patterns for African American students are also exhibited in OLS specifications. 
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decomposed by ethnicity. One feature that enhances EOG analysis is the inclusion of 
parent education level of the student taking the exam.^^ Analogous information is 
collected for EOC exams but question regarding the reliability of the data recorded at the 
secondary level has lead NCDPI not to report these results. 

As with the EOC exams, EOG exams have a state calculated composite score (the 
average test score for each district across all subject areas, including writing) that is 
reported. Those results are reported in Table V at each sub-sample level: 117 districts, 
100 counties, and for the 88 “unified” districts/counties. As with the EOC analysis, 
specifications were conducted and evaluated at all grade levels and content areas, 
although only the composite test results are reported. Each model was specified as in 
Table V. Again, like the EOC results, most of the specifications failed to produce any 
significant private school competition effect, whether positive or negative (with one 
exception discussed below), however, several trends are worth noting. 

Estimates at the 117 district and 88 “unified” district/county levels displayed similar 
patterns to those observed in the EOC analysis. Instrumental variables specifications 
failed to record any significant variables, with the lone exception of minority public 
school concentration, which exhibited the expected relationship (a negative impact on 
students performing at grade level or beyond)(see Table V). Both the private school and 
Catholic variable estimates were associated with large standard errors (again. 
White/robust standard errors) and were not significant. Catholic membership did 
demonstrate the expected positive relationship to private school participation in the first 
stage instrumental variables equations, albeit an insignificant one (see bottom of Table 
V). Parent education also exhibited the expected relationship throughout most 
specifications: as the percentage of students with parents with college education 



Parent education level is defined as those parents with at least some college education (two-year college, 
four year college, or having graduate degrees)(see Table V). The full listing of parent education levels is 
provided in Table I. 
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increased, the percentage of students scoring at or above grade level on EOG exams 
increased.^^ 

Two patterns of note were the overall performance at the 100 coimty- level, and one 
incidence of a significant private school competition effect. First, the specifications at the 
100 coimty-level exhibited the same trends as the other two sub-samples, with one 
important exception: the standard errors on all the variables of interest, in particular the 
private school enrollment and Catholic membership estimates, were significantly smaller 
than in either of the other two sub-samples. Note also that when Couch et al foimd 
significant private school competition effects they were analyzing test scores at the 100 
county-level. This can also be seen in Table V, where nearly all of the standard errors are 
significantly lower at the 100 coimty-level, a trend not found in EOC analysis. 

One possible explanation is that failure to adequately account for intergovernmental 
competition between city and county school districts may be introducing “noise” into the 
estimates. With the increasing importance of charter school education throughout North 
Carolina, especially at the elementary level, this may not be a trivial concern and needs to 
be addressed. Again, recall that by far the majority of North Carolina’s private school 
students are concentrated at the elementary level: grades K-8 accounted for nearly 80 
percent (79.4 percent) of total private school enrollment in 1998-1999. 

A second note of interest in the 100 district/coimty level sub-sample, are two findings of 
nearly significant (at the 10 percent level of significancy) private school competition 
effects. Both occur in EOG math exams (at grades 3 and 7) and both occur only in OLS 
specifications. For a 10 percent increase in private school enrollment within the 
district/county there is a -3.91 (standard error = 0.23) percent or -3.40 percent (standard 
error = 0. 19) reduction in the percentage of students scoring at or above grade level for 



Interestingly, parent education became less significant in specifications in the 88 county/district sub- 
sample than in either of the other two sub-samples, which both recorded fairly significant impacts on test 
scores, mostly in the OLS estimates. 
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grades 3 and 7 respectively.^* So, the two lone incidences of private school competition 
effects are found only in math, the same metric of student performance chosen by Couch 
et al, and exhibits a negative impact on students performing at or above grade level, 
although the finding is not significant at conventional levels (5 or 1 percent). Still the 
result merits noting. 

Dropout Rates: Analysis of the 117 Districts, 100 Counties and 88 “Unified” Districts 
As mentioned previously, several researchers have found significant and beneficial 
impacts fi'om private school competition on public school graduation rates and reductions 
in dropout rates (Altonji et al 2000; Dee 1998; Evans and Schwab 1995; Hoxby 1994®; 
Neal 1997 and 1998; and Sander and Krautman 1995). NCDPI produced two separate 
dropout rates for the 1998-1999 school year: for grades 7-12 (inclusive of middle school) 
and one for grades 9-12 (see footnote 21 above for the formal definition). Additionally, 
the State produces a student retention rate. All three rates were evaluated for all three 
sub-sample levels (1 17, 100 and 88). 

Unlike the results of previous studies, there is no evidence of any significant private 
school competition effects on any of the three rates, regardless of sub-sample (117, 100, 
or 88) or specification (OLS or fV). Table V reports the dropout rate results for grades 9- 
12 in the final six columns of the table. Notice that the Catholic membership coefficient 
is right-signed (bottom of Table V), but again insignificant. 

One trend that continued fi'om the EOG analysis was the reduction in standard error sizes 
for estimates at the 1 00-district/county level sub-sample, especially for the Catholic 
membership and private school enrollment variables (see Table V). 



OLS covariates are the same as those listed in Table V for EOG exams with Catholic membership and 
percent of adults over the age of 25 with college degrees being omitted. The percent of adults with college 
degrees, a county measure, was only used in one specification, the one displayed in Table V, the last EOG 
specification. 
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Instrument Validity 

The literature has become increasingly concerned over the appropriateness of using 
Catholic membership, concentration/density, or proximity to Catholic institutions as 
legitimate instruments for analysis and overcoming issues of simultaneity. A recent study 
reviewed the use of Catholic variables (religious affiliation, proximity to Catholic 
schools, and interactions between affiliation and proximity) with two data sets, used 
frequently in this research: the National Educational Longitudinal Study of 1988 
(NELS:88) and the National Longitudinal Study of the High School Class of 1972 (NLS- 
72)(Altonji et al 2002). While not finding uniformly consistent results, the authors did 
find that the three instruments evaluated in the NELS:88 data set produced biased 
estimates. The authors could not estimate the magnitude of the bias in the NLS-72 data 
set (Altonji 2002, p. 22). 

Several authors within the literature, in particular Figlio and Stone (1999), have argued 
that Catholic membership is not truly exogenous to participation/enrollment in private 
schools, thus producing biased coefficient estimates (see also: Kane 1996; Mumane et al 
1985; and Sander 1996). Figlio and Stone further contend that Catholic school students 
(those that are practicing Catholics) are systematically different, particularly in their 
student achievement, from their other non-Catholic public school student peers (Figlio 
and Stone 1999, p. 125).^^ 

In contrast to this contention is a study by Sander (1996) of non-Hispanic white Catholic 
school students. Sander finds that, after controlling for issues of selection, an eight-year 
tenure in Catholic schools produces higher vocabulary, mathematics and reading scores 
(although no effect on science scores were found). Further, Sander finds no evidence of 



Figlio and Stone propose two novel instruments in place of Catholic membership/concentration: union 
laws in states where analysis is being conducted. Specifically, they use whether a state has “duty to 
bargain” or “right to work” laws, and then interact these with (i) median county income, and (ii) the 
student’s family socioeconomic status. The authors maintain that these instruments are correlated with 
school sector choice (they use a multinomial logit three-sector (public, private-religious, private- 
nonreligious) choice model) but independent of the unexplained variation (the error term) in the student 
achievement equation (Figlio and Stone 1999, p. 121). 

In personal communication with the author, several economists have noted off-handedly that there may 
be economies of scale at work in public school science departments and curriculum, which may account for 
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positive selection (the “cream skimming” scenario) into Catholic schools, and, most 
importantly for Figlio and Stone’s contention, Sander found the achievement gains were 
being driven by non-Catholic (non-practicing Catholics within Catholic schools) students 
(Sander 1996, p. 545). Once these non-Catholic students left Catholic institutions, their 
student achievement gains fell to zero. This finding stands in stark contrast to Figlio and 
Stone’s contention that Catholics systematically out perform many other student groups. 

A further consideration is the technical performance of the instrument itself Bound et al 
(1995) have argued finding valid instruments may be much more difficult than previously 
thought. First, the authors contend that if the chosen instruments (Catholic membership in 
this case) explain little of the variation in the endogenous variable (private school 
enrollment), there may exits large inconsistencies between IV estimates and those 
produced by OLS, even if the correlation between the instruments and the unexplained 
variation (the error term in the student achievement equation) is weak. Their second 
contention is that the instrumental variables estimates will be biased in the same direction 
as the OLS estimates. 

The lack of explanatory power in the chosen instruments has particular relevance in this 
study of North Carolina data, specifically when considering the relatively small 
concentration of Catholics within the state. While the Catholic population within North 
Carolina is one of the fastest growing demographic groups,^' with private school 
education being largely provided by religious institutions. Catholic schools represent a 
minority segment of the private school market.^^ The hypothesized relationship of a 
positive relationship between Catholic concentration and public school provision may 



some of the achievement differentials in this content area between public and private school students. I 
have not found this argument made formally in the literature. 

Primarily for two reasons: (1) the exponential growth of the Hispanic population within North Carolina; 
and (2), the continued migration of Northern residents into North Carolina. 

For 1998-1999: Total private schools = 626 (independent/secular = 193 (30.8%), religious = 433 
(69.2%)); total private school enrollment = 84,384 (independent/secular = 25,162 (29.8%), religious = 
59,222 (70.2%)). School figures do not include special (27 schools), home or charter schools, and 
enrollment figures do not include home or charter school enrollment (but do include private special school 
enrollment). See: 

http://www.doa.state.nc.us/dnpe/hhh548.htm 
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indeed exist, however, the lack of critical Catholic masses within the state may be 
significantly reducing the instruments power and efficacy. 

A series of Hausman tests were conducted to see if there were systematic differences 
between the OLS and instrumental variables specifications. In several cases, estimates 
failed to reject the null hypothesis,^^ indicating that the instrumental variables are not 
systematically different from the OLS estimates. It appears that using Catholic 
membership as an instrument for private school enrollment did not insulate the variable 
from simultaneity bias and may not have aided the analysis. In this instance, the 
coefficient estimates may be even more inefficient than the OLS results when not 
accoimting for endogenity. 

Another explanation for the disparity in findings across studies and within this current 
study is the issue of aggregation. Jepsen has recently foimd (2001) that research 
estimating the effects of private school competition will have coefficient estimates that 
are highly sensitive to the data set, the grade level, the level of aggregation of the 
competition variable employed, and whether OLS or instrumental variables techniques 
are used. The metric of private school competition chosen (enrollment vs. percent of 
private schools in an area for instance) can have significant impacts on estimates (Jepsen 
2001, pp. 17-18). That coupled with limitations of the instrument may accoimt for the 
insignificant results. ' 



VIII. Conclusions 

This study has produced several results that can help inform the larger body of research 
while contributing to the school choice discussion. First, no significant private school 
competition effects (with the exception of the marginally significant, but noteworthy 
EOG math exams at grades 3 and 7) were found, regardless of the specification, sub- 
sample or measure of student performance employed. Second, as an attempt to duplicate 
Couch et al’s study, the current study made allowances for several elements 
(endogeneity, expanding the measure of student outcomes, and by specifying models 

Ho = differences in coefficient estimates are not systematic. 
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with extended controls), but still failed to produce similar findings. Third, several 
patterns found in the larger literature emerged within this study: there is slight evidence 
that African American public school students may be more sensitive to private school 
competition than other ethnic groups; and there is no evidence in this data set of the 
competition effect being age-specific or concentrated within a specific grade level. 

The findings also help to advance and contribute to the larger research in several areas 
where it demonstrated limitations or failure to produce results. First, the need to account 
for selection: since this study sought to account for endogeneity and duplicate Couch et 
al’s results, a selection model was not employed. The lack of significant effects may be, 
in part, attributable to the lack of control for student sorting and selection between 
schools. 

Another aspect to consider is the role played by intergovernmental competition. 
Competition between public institutions has become a research focus of late, and may 
include competition between schools (public vs. charter) or take the form of multi- 
districting and open enrollment policies (see Taylor 2000 for a review of the literature; 
Blair and Staley 1995; Borland and Howsen 1992, 1993 & 2000; Epple and Romano 
1998; Hoxby 1994*’ & 2000; Kenyon 1997; and Zanzig 1997). Considering North 
Carolina’s increasing number of charter schools, failure to find a significant private 
school competition effect may be due parents and students exercising school choice in 
terms of charter school preferences.^'* 

A recent study by Holmes, DeSimone and Rupp (2003) has found that introduction of 
charter school competition in North Carolina lead to an approximate one percent increase 

However, total charter school enrollment (K-12) for 1998-1999 was substantially smaller than total 
private school enrollment (K-12): 8,234 and 84,384 respectively. 
http://www.ncpublicschools.org/fbs/stats/pdf/1999pl.pdf 
http://www.doa.state.nc.us/dnpe/hhh548.htm 

Since the 1998-1999 academic year total charter school enrollment (K-12) has risen by nearly 111 percent 
to 17,354 while total private school enrollment (K-12) has increased by approximately 9 percent to 91,817 
in 2001-2002. 

http://www.ncpublicschools.org/fbs/stats/StatProfile02.pdf 
http://www.doa.state.nc.us/dnpe/hhh55 1 .htm 
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in test scores for traditional public school students, and accounts for nearly one quarter of 
the mean standard deviation of observed gains (Holmes et al 2003, p. 15). The authors 
use several models (standard cross-section, IV panel, and maximum likelihood models), 
and the results are robust across specifications, indicating that charter school competition 
may account for more of the competition effects in North Carolina than private schools. 
However, when charter school enrollment was included as the metric of competition in 
this study, regardless of public school student outcome used, the results failed to produce 
any significant competition effects. 

Finally, decisions to use instrumental variables approaches and whether or not to use 
Catholic membership or related measures to instrument for private school competition is 
an open question. Several authors have used this approach fruitfully and on different data 
sets, however questions remain. Differences of aggregation may explain some of the 
divergence in empirical results. The literature has not arrived at a consensus regarding 
this issue. Fruitful research will need to address and expand these issues to help inform 
our imderstanding of school choice and its implications for America’s educational 
system. 




3 



3 



33 



Works Cited 

Alexander, Karl L., and Aaron M. Pallis. (1982). “Reply to Coleman.” ^/wencan 
Sociological Review, December, 47(6): pp. 822-824. 

Alexander, Karl L., and Aaron M. Pallis. (1983). “Private Schools and Public Policy: 

New Evidence on Cognitive Achievement in Public and Private Schools.” Sociology of 
Education, 56(4): pp. 170-182. 

Alexander, Karl L., and Aaron M. Pallis. (1985). “School Sector and Cognitive 
Performance: When is a Little a Little?” Sociology of Education, April, 58(2): pp. 115- 
128. 

Altonji, Joseph G., Todd E. Elder, and Christopher R. Taber. (2000). “Selection on 
Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools.” 
National Bureau of Economic Research (Cambridge, MA) Working Paper No.# 7831, 
August. 

Altonji, Joseph G., Todd E. Elder, and Christopher R. Taber. (2002). “An Evaluation of 
Instrumental Variable Strategies for Estimating the Effects of Catholic Schools.” 
National Bureau of Economic Research (Cambridge, MA) Working Paper No.# 9358, 
November. 

Argys, Laura M., Daniel I. Rees and Dominic J. Brewer. (1996). “Detracking America’s 
Schools: Equity at Zero Cost?” Journal of Policy Analysis and Management, fall, 

15(4): pp. 623-645. 

Arum, Richard. (1996). “Do Private School Force Public Schools to Compete?” 

American Sociological Review, February, 61(1): pp. 29-46. 

Becker, Gary S. (1993)[1964]. Human Capital: A Theoretical and Empirical Analysis, 
With Special Reference to Education, third edition. Chicago: University of Chicago 
Press. 

Betts, Julian R. (1995). “Does School Quality Matter? Evidence from the National 
Longitudinal Survey of Youth.” Review of Economics and Statistics, May, 77(2): pp. 
231-250. 

Betts, Julian R. and Jamie L. Shkolnik. (2000®). “The Effects of Ability on Student 
Achievement and Resource Allocation in Secondary Schools.” Economics of Education 
Review, Febrary, 19(1): pp. 1-15. 

Betts, Julian R. and Jamie L. Shkolnik. (2000*’). “Key Difficulties in Identifying the 
Effects of Ability Grouping on Student Achievement.” Economics of Education 
Review, February, 19(1): pp. 21-26. 




34 



Blair, John P. and Sam Staley. (1995). “Quality Competition and Public Schools: Further 
'Ev'iA&o.cq!' Economics of Education Review, June, 44(2): pp. 193-198. 

Borland, Melvin V. and Roy M. Howsen. (1992). “Student Academic Achievement and 
the Degree of Market Concentration in Education.” Economics of Education Review, 
March, ll(l):pp. 31-39. 

Borland, Melvin V. and Roy M. Howsen. (1993). “On the Determination of the Critical 
Level of Market Concentration in Education.” Economics of Education Review, Jime, 
12(2): pp. 165-169. 

Borland, Melvin V. and Roy M. Howsen. (1996). “Competition, Expenditures and 
Student Performance in Mathematics: A Comment on Couch et al.” Public Choice, 
June, 87(3/4): pp. 395-400. 

Borland, Melvin V. and Roy M. Howsen. (2000). “Manipulable Variables of Policy 
Importance: The Case of Education.” Education Economics, December, 8(3): pp. 241- 
248. 

Bound, John, David A. Jaeger, and Regina M. Baker. (1995). “Problems With 
Instrumental Variables Estimation When the Correlation Between the Instruments and 
the Endogenous Explanatory Variable is Weak.” Journal of the American Statistical 
Association, June, 90(430): pp. 443-450. 

Buchanan, James M. (1968). The Demand and Supply of Public Goods. Chicago: Rand 
McNally & Company. 

Cain, Glen G., and Arthur S. Goldberger. (1983). “Public and Private Schools Revisited.” 
Sociology of Education, October, 56(4): pp. 208-218. 

Card, David and Alan B. Krueger. (1992). “Does School Quality Matter? Returns to 
Education and the Characteristics of Public Schools in the United States.” Journal of 
Political Economy, February, 100(1): pp. 1-40. 

Card, David and Alan B. Krueger. (1996). “School Resources and Student Outcomes: An 
Overview of the Literature and New Evidence from North and South Carolina.” 

Journal of Economic Perspectives, fall, 10(4): pp. 31-50. 

Caucutt, Elizabeth M. (2002). “Educational Vouchers When There are Peer Group 
Effects — Size Matters.” International Economic Review, February, 43(1): pp. 195-222. 

Chubb, John E. and Terry M. Moe. (1988). “Politics, Markets, and the Organizations of 
Schools." American Political Science Review, December, 82(4): pp. 1065-1087. 

Chubb, John E. and Terry M. Moe. (1990). Politics, Markets, and America ’s Schools. 
Washington D.C.: Brookings Institution Press. 




35 



35 



Coleman, James S. (1982). “The Use of ‘Ability’ Measures as Controls for Concurrent or 
Subsequent Achievement.” yJmen'caw Sociological Review, December, 47(6): pp. 819- 
821. 

Coleman, James S., Ernest Q. Campbell, Carol J. Hobson, James McPartland, Alexander 
M. Mood, Frederic D. Weinfeld, and Robert L. York. (1966). Equity and Educational 
Opportunity. Washington, D.C.; U.S. GPO. 

Coleman, James S. and Thomas Hoffer. (1983). “Response to Taeuber- James, Cain- 
Goldberger and Morgan.” Sociology of Education, October, 56(4): pp. 219-234. 

Coleman, James S. and Thomas Hoffer. (1987). Public and Private Schools: The Impact 
of Communities. New York: Basic Books. 

Coleman, James S., Thomas Hoffer, and Sally BCilgore. (1981). “Questions and Answers: 
Our Response.” Harvard Educational Review, November, 51(4): pp. 526-545. 

Coleman, James S., Thomas Hoffer, and Sally BCilgore. (1982®). “Cognitive Outcomes in 
Public and Private Schools.” Sociology of Education, April/July, 55(2/3): pp. 65-76. 

Coleman, James S., Thomas Hoffer, and Sally BCilgore. (1982*’). “Achievement and 
Segregation in Secondary Schools: A Further Look at Public and Private School 
Differences.” Sociology of Education, April/July, 55(2/3): pp. 162-182. 

Coleman, James S., Thomas Hoffer, and Sally BCilgore. (1982®). High School 
Achievement: Public, Catholic, and Private Schools Compared. New York: Basic 
Books. 

Couch, Jim F., William F. Shughart U, and A1 L. Williams. (1993). “Private School 
Enrollment and Public School Performance.” Public Choice, August, 76(4): pp. 301- 
312. 

Couch, Jim F. and William F. Shughart U. (1995). “Private School Enrollment and Public 
School Performance: RjspXy." Public Choice, March, 82(3/4): pp. 375-379. 

Couch, Jim F. and William F. Shughart U. (1996). “Competition, Expenditures and 
Student Performance: Reply to Borland and Howsen.” Public Choice, June, 87(3/4): pp. 
401-403. 

Dee, Thomas S. (1998). “Competition and the Quality of Public Schools.” Economics of 
Education Review, October, 17(4): pp. 419-427. 

Dee, Thomas S. (2003). “Are There Civic Returns to Education?” National Bureau of 
Economic Research (Cambridge, MA) Working Paper No.# 9588, March. 




36 



36 



Epple, Dennis and Richard E. Romano. (1998). “Competition Between Private and Public 
Schools, Vouchers, and Peer-Group Effects.” American Economic Review, March, 
88(1): pp. 33-62. 

Epple, Dermis and Richard E. Romano. (2002). “Educational Vouchers and Cream 
Skimming.” National Bureau of Economic Research (Cambridge, MA) Working Paper 
No.# 9354, November. 

Epple, Denis, Elizabeth Newlon and Richard E. Romano. (2002). “Ability Tracking, 
School Competition, and the Distribution of Educational Benefits.” Jowrwa/ of Public 
Economics, January, 83(1): pp. 1-48. 

Evans, William N., and Robert M. Schwab. (1995). “Finishing High School and Starting 
College: Do Catholic Schools Make a Difference?” Quarterly Journal of Economics, 
November, 110(4): pp. 941-974. 

Evans, William N., Wallace E. Oates, and Robert M. Schwab. (1992). “Measuring Peer 
Grroup Effects: A Study of Teenage Behavior.” Journal of Political Economy, October, 
100(5): pp. 966-991. 

Figlio, David N. (2002). “School Choice and the Distributional Effects of Ability 
Tracking: Does Separation Increase Inequality?” Journal of Urban Economics, May, 
51(3): pp. 497-514. 

Figlio, David N. and Lawrence S. Getzler. (2002). “Accountability, Ability and 
Disability: Gaming the System.” National Bureau of Economic Research (Cambridge, 
MA) Working Paper No.# 9307, October. 

Figlio, David N. and Jens Ludwig. (2000). “Sex, Drugs, and Catholic Schools: Private 
Schools and Non-Market Adolescent Behaviors.” National Bureau of Economic 
Research (Cambridge, MA) Working Paper No.# 7990, November. 

Figlio, David N. and Joe Stone. (1999). “Are Private School Really Better?” Published in 
Solomon W. Polachek and John Robst (eds.). Research in Labor Economics, Vol.# 18. 
Stamford, CT: JAI Press. 

Friedman, Milton. (1955). “The Role of Government in Education.” Published in Robert 
A. Solo (ed.). Economics and the Public Interest. New Brunswick, NJ: Rutgers 
University Press. 

Goldhaber, Dan D. (1996). “Public and Private High Schools: Is School Choice an 
Answer to the Productivity Problem?” Economics of Education Review, April, 15(2): 
pp. 93-109. 

Gradstein, Mark and Moshe Justman. (2000). “Human Capital, Social Capital, and Public 
Schooling.” European Economic Review, May, 44(4-6): pp. 879-890. 




r\ ^ 



37 



Grossman, Sanford J. and Joseph E. Stiglitz. (1976). “Information and Competitive Price 
Sysiom.'' American Economic Review, May, 66(2): pp. 246-253. 

Hanushek, Eric A. (1986). “The Economics of Schooling: Production and Efficiency in 
Public Schools.” JoMr«a/ of Economic Literature, September, 24(3): pp. 1141-1177. 

Hanushek, Eric A. (1989). “The Impact of Differential Expenditures on School 
Performance.” Educational Researcher, May, 18(4): pp. 45-51. 

Hanushek, Eric A. (2002). “Public Provided Education.” National Bureau of Economic 
Research (Cambridge, MA) Working Paper No.# 8799, February. 

Hanushek, Eric A., John F. Kain, Jacob M. Markman, and Steven G. Rivkin. (2000). 
“Does Peer Ability Affect Student Achievement?” Unpublished manuscript. May, 
revised August 2001 . 

http://edpro.stanford.edu/eah/papers/peers.augO 1 .PDF 

Hanushek, Eric A. and Margaret E. Raymond. (2001). “The Confusing World of 
Educational Accountability.” National Tax Journal, June, 54(2): pp. 365-384. 

Hayek, Friedrich A. (1945). “The Use of Knowledge in Society.” Published in Hayek 
1980. 

Hayek, Friedrich A. (1946). “The Meaning of Competition.” Published in Hayek 1980. 

Hayek, Friedrich A. (1968). “Competition as a Discovery Procedure.” Published in 
Hayek. 1978. 

Hayek, Friedrich A. (1978). New Studies in Philosophy, Politics, Economics and the 
History of Ideas. Chicago: University of Chicago Press. 

Hayek, Friedrich A. (1980)[1948]. Individualism and Economic Order. Chicago: 
University of Chicago Press. 

Heckman, James J. (1979). “Sample Selection Bias as a Specification Error.” 
E'cono/neMcm, January, 47(1): pp. 153-161. 

High School and Beyond: A National Longetudinal Study for the 1980 ’s (1981). 
Conducted for the National Center for Education Statistics, U.S. Dept, of Education, 
Chicago: National Opinion Research Center. 

Hoffer, Thomas, Andrew M. Greeley and James S. Coleman. (1985). “Achievement 
Growth in Public and Catholic Schools.” Sociology of Education, April, 58(2): pp. 74- 
97. 




38 



38 



Holmes, George M., Jeff DeSimone and Nicholas G, Rupp. (2003). “Does School Choice 
Increase School Quality.” National Bureau of Economic Research (Cambridge, MA) 
Working Paper No.# 9683, May. 

Hoxby, Caroline M. (1994^). “Do Private Schools Provide Competition for Public 
Schools?” National Bureau of Economic Research (Cambridge, MA) Working Paper 
No.# 4978, December. 

Hoxby, Caroline M. (1994*’). “Does Competition Among Public Schools Benefit Students 
and Taxpayers?” National Bureau of Economic Research (Cambridge, MA) Working 
Paper No.# 4979, December. Revised 2000. 

Hoxby, Caroline M. (1998). “What Do America’s ‘Traditional’ Forms of School Choice 
Teach Us about School Choice Reforms?” Economic Policy Review FRBNY, March, 
4(1): pp. 47-59. 

Hoxby, Caroline M. (2000^). “Peer Effects in the Classroom: Learning From Gender and 
Race Variation.” National Bureau of Economic Research (Cambridge, MA) Working 
Paper No.# 7867, August. 

Hoxby, Caroline M. (2000*’). “Does Competition Among Public Schools Benefit Students 
and Taxpayers?” yfwerzcaw Economic Review, December, 90(5): pp. 1209-1238. 

Hoxby, Caroline M. (2001). “How School Choice Affects the Achievement of Public 
School Students.” Unpublished manuscript, September 20-21. 
htt p://post.economics.harvard.edu/facultv/hoxbv/papers/choice sepO 1 .pdf 

Jencks, Christopher. (1985). “How Much Do High School Students Learn?” Sociology of 
Education, April, 58(2): pp. 128-135. 

Jepsen, Christopher. (2001). “The Role of Aggregation in Estimating the Effects of 
Private School Competition on Student Achievement.” Unpublished manuscript. Public 
Policy Institute of California, August. 

Kane, Thomas J. (1996). “Comments on Chapters Five and Six.” Published in Ladd (ed.) 
1996. 

Kennedy, Peter. (1998). A Guide to Econometrics, Fourth Edition. Cambridge, MA: The 
MIT Press. 

Kenyon, Daphne A. (1997). “Theories of Inteijurisdictional Competition.” New England 
Economic Review FRBB, March/ April: pp. 13-28. 

Krueger, Alan B. (1999). “Experimental Estimates of Education Production Fxmctions.” 
Quarterly Journal of Economics, May, 114(2): pp. 497-532. 



ERIC 




39 



Ladd, Helen F. (ed.). (1996). Holding Schools Accountable: Performance-Based Reform 
in Education. Washington, D.C.: Brookings Institute. 

Ladd, Helen F. (2001). “School-Based Educational Accountability Systems: The Promise 
and the Pitfalls.” National Tax Journal, June, 54(2): pp. 385-400. 

Ladd, Helen F. and Edward B. Fiske. (2000). When Schools Compete: A Cautionary 
Tale. Washington, D.C.: Brookings Institute Press. 

Ladd, Helen F. and Edward B. Fiske. (2001). “The Uneven Playing Field of School 
Choice: Evidence from New Zealand.” Journal of Policy Analysis and Management, 
winter, 20(1): pp. 43-64. 

Ladd, Helen F. and Janet S. Hanson (eds.). (1999). Making Money Matter: Financing 
America ’s Schools. Washington, D.C.: National Academy Press. 

Lott, John R. Jr. (1990). “An Explanation for Public Provision of Schooling: The 
Importance of Indoctrination.” Journal of Law and Economics, April, 33(1): pp. 199- 



Lott, John R. Jr. (1999). “Public Schooling, Indoctrination, and Totalitarianism.” Journal 
of Political Economy, December, 107(6, pt. 2): pp. S127-S157. 

Machlup, Fritz. (1970). Education and Economic Growth. Lincoln, NE: University of 
Nebraska Press. 

Mocan, H. Nanci, Benjamin Scafidi, and Erdal Te ki n. (2002). “Catholic Schools and Bad 
Behavior.” National Bureau of Economic Research (Cambridge, MA) Working Paper 
No.# 9172, September. 

Mumane, Richard J. (1984). “A Review Essay - Comparisons of Public and Private 
Schools: Lessons from the Uproar.” Journal of Human Resources, spring, 19(2): pp. 



Mumane, Richard J., Stuart Newstead, and Randall J. Olsen. (1985). “Comparing Public 
and Private Schools: The Puzzling Role of Selectivity Bias.” Journal of Business & 
Economic Statistics, January, 3(1): pp. 23-35. 

Mumane, Richard J., John B. Willet, and Frank Levy. (1995). “The Growing Importance 
of Cognitive Skills in Wage Determination.” Review of Economics and Statistics, May, 
77(2): pp. 251-266. 

Neal, Derek. (1997). “The Effects of Catholic Secondary Schooling on Educational 
Achievement.” /oMrna/ of Labor Economics, January Part 1, 15(1): pp. 98-123. 



231. 



263-277. 



ERIC 




40 



Neal, Derek. (1998). “What Have We Learned About the Benefits of Private Schooling?” 
Economic Policy Review FRBNY, March, 4(1): pp. 79-86. 

Neal, Derek and Jeffrey Grogger. (2000). “Further Evidence on the Effects of Catholic 
Secondary Schooling.” Published in William G. Gale and Janet Rothenberg Pack (eds.). 
Brookings-Wharton Papers on Urban Affairs. Washington D.C.: Brookings Institution 
Press. 

Newmark, Craig M. (1995). “Another Look at Whether Private Schools Influence Public 
School Quality; Comment.” Public Choice, March, 82(3-4): pp. 365-373. 

Noell, Jay. (1982). “Public and Catholic High Schools: A Reanalysis of ‘Public and 
Private Schools.’” Sociology of Education, April/July, 55(2/3): pp. 123-132. 

Noell, Jay. (1983). “A Response to Coleman, Hoffer and Kilgore.” Sociology of 
Education, October, 56(4): p. 203. 

North Carolina Department of Public Instruction (NCDPI). (1998). “State of North 
Carolina Graduation Requirements.” Raleigh, NC: NCDPI. 

North Carolina Department of Public Instruction (NCDPI), Assessment Brief. (1999^). 
“Understanding End-of-Course Testing: Scores and Standards,” fall, 6(5): pp. 1-4. 
http://www.ncpublicschools.org/accountability/testing/eoc/asb_eocscst.pdf 

North Carolina Department of Public Instruction (NCDPI). (1999*’). The North Carolina 
Statistical Profile, 1999. Raleigh, NC: NCDPI. 
http://www.ncpublicschools.org/fbs/stats/statl999.html 

North Carolina Department of Public Instruction (NCDPI). (2000). A Report Card for the 
ABCs of Public Education Volume II, 1999-2000. “Subgroup and Supplemental Data: 
Data Definitions.” Raleigh, NC: NCDPI. 

Oakes, Jeannie. (1985). Keeping Track: How Schools Structure Equality. New Haven, 

CT and London: Yale University Press. 

Oakes, Jeannie. (1990). Multiplying Inequalities: The Effects of Race, Social Class, and 
Tracking on Opportunities to Learn Mathematics and Science. Santa Monica, CA: 
RAND Corporation. 

Oakes, Jeannie.(1992). “Can Tracking Research Inform Practice? Technical, Normative 
and Political Considerations.” Educational Researcher, 21: pp. 12-21. 

Rees, D.I., D.J. Brewer, and L.M. Argys. (2000). “How Should We Measure the Effect of 
Ability Grouping on Student Performance?” Economics of Education Review, February, 
19(1): pp. 17-20. 




4 



41 



Rivkin, Steven G. (2001). “Tiebout Sorting, Aggregation and the Estimation of Peer 
Group Effects.” Economics of Education Review, June, 20(3): pp. 201-209. 

Sander, William. (1996). “Catholic Grade Schools and Academic Achievement.” /oMr/ja/ 
of Human Resources, summer, 31(3): pp. 540-548. 

Sander, William. (1997). “Catholic High Schools and Rural Academic Achievement.” 
American Journal of Agricultural Economics, February, 79(1): pp. 1-12. 

Sander, William. (1999). “Private Schools and Public Achievement.” Journal of Human 
Resources, fall, 34(4): pp. 697-709. 

Sander, William and Anthony C. Rrautmann. (1995). “Catholic Schools, Dropout Rates 
and Educational Attainment.” Economic Inquiry, April, 33(2): pp. 217-233. 

Simon, Christopher A. and Nicholas P. Lovrich, Jr. (1996). “Private School Enrollment 
and Public School Performance: Assessing the Effects of Competition Upon Public 
School Student Achievement in Washington State.” Policy Studies Journal, winter, 
24(4): pp. 666-675. 

Stiglitz, Joseph E. (1974). “The Demand for Education in Public and Private School 
Journal of Public Economics, November, 3(4): pp. 349-385. 

Stiglitz, Joseph E. (2000®). Economics of the Public Sector, third edition. New York and 
London: W.W. Norton & Company. 

Stiglitz, Joseph E. (2000*’). “’’The Contributions of the Economics of Information to 
Twentieth Century Economics.” Quarterly Journal of Economics, November, 115(4): 
pp. 1441-1478. 

Taylor, Lori L. (2000). “The Evidence on Government Competition.” Economics and 
Financial Review FRBD, Second Quarter: pp. 2-10. 

Thomsen, Esteban F. (1992). Prices and Knowledge: A Market-Process Perspective. 
Routledge: London and New York. 

Vickers, John. (1995). “Concepts of Competition.” Oxford Economic Papers, January, 
47(1): pp. 1-23. 

West, Edwin G. (1965). Education and the State: A Study in Political Economy. London: 
Institute of Economic Affairs. 

Willms, J. Douglas. (1985). “Catholic-School Effects on Academic Achievement: New 
Evidence from the High School and Beyond Follow-Up Study.” Sociology of 
Education, April, 58(2): pp. 98-114. 




42 



42 



Witte, John F. (1992). “Private School Versus Public School Achievement: Are There 
Findings that Should Affect the Educational Choice Debate.” Economics of Education 
Review, December, 11(4): pp. 371-394. 

Zanzig, Blair R. (1997). “Measuring the Impact of Competition in Local Government 
Education Markets on the Cognitive Achievement of Students.” Economics of 
Education Review, October, 16(4): pp. 431-441. 

Zelman v. Simmons-Harris, 00-1751 U.S. 976 (2002) 

Zimmer, Ron W. (2003). “A New Twist in the Educational Tracking Debate.” Economics 

of Education Review, June, 22(3): pp. 307-315. 

Zimmer, Ron W. and Eugenia F. Toma. (2000). “Peer Effects in Private and Public 
Schools Across Countries.” Journal of Policy Analysis and Management, winter, 19(1): 
pp. 75-92. 




43 



Table I 

Descriptive Statistics 
NC Public School Data, 1998-1999 



Variable 

Public School End’Of’Course Exams* 

Algebra I (%) 

Biology (%) 

Economic, Legal, and Political Systems (ELPS) (%) 

U.S. History (%) 

Composite Test Score Average (all subjects) (%) 

Average Test Score of Four Required Subjects, All Students (%) 
Average Test Score of Four Required Subjects, Blacks Only (%) 
Public School End-of'Grade Exams* 

Composite Test Score Average (all subjects) (%) 

Public School Dropout Rate 

Grades 9-12 Duplicate Dropout Rate (%) 

School District Enrollment 

Catholic Membership (%) 

Public School Enrollment (%) 

Chater School Enrollment (%) 

Private School Enrollment (%) 

School District Level Data 

Number of Children (age 5-17) in Poverty, 1997 (%) 

Median Household Income ($) 

Adults Over 25 with a College Degree in 1990 (%) 

Population Density 

Parent's Education of Student’s Taking EOG Exams 
Did Not Finish High School (%) 

High School Graduate (%) 

Trade/Business School (%) 

Community College (%) 

Four Year College (%) 

Graduate School (%) 

Public School Data 

Total Per Pupil Expenditure ($) 

Per Pupil Capital Expenditure, 5 Year Avg. ($) 

Number of Violent Acts, per 1000 
Black Public School Enrollment (%) 

Hispanic Public School Enrollment (%) 

American Indian Public School Enrollment (%) 

Asian Public School Enrollment (%) 

White Public School Enrollment (%) 

Public School Teacher Data 

Teachers with Less than Bachelors Degree (%) 

Teachers with Bachelor (%) 

Teachers with Masters (%) 

Teachers with Sixth Year Level (%) 

Teachers with Doctorate (%) 

Teachers with No Prior Experience (%) 

Notes : See the Data Appendix for variable information. 



N 


Mean 


Std. Dev. 


Minimum 


Maximum 


117 


65.8 


. 12.10 


22.1 


90.7 


117 


57.7 


9.83 


16.7 


80.3 


117 


68.4 


8.94 


29.3 


96.7 


117 


48.6 


10.33 


15.7 


86.6 


117 


57.6 


9.69 


25.4 


83.9 


117 


60.1 


7.47 


27.1 


81.7 


103** 


40.8 


6.82 


23.8 


59.3 


117 


75.0 


5.40 


54.5 


90.0 


117 


6.8 


1.44 


2.3 


11.3 


117 


5.8 


4.05 


0 


22.5 


117 


93.0 


4.43 


84.0 


100 


117 


0.6 


1.03 


0 


13.4 


117 


6.3 


4.12 


0 


13.4 


117 


16.6 


4.76 


9.4 


33.7 


117 


36,332 


6,879.26 


21,616 


51,391 


117 


17.7 


9.22 


6.6 


46.10 


117 


406.3 


371.47 


9.5 


1321.5 


117 


11.1 


5.11 


3.1 


33.9 


117 


43.9 


9.38 


11.9 


64.7 


117 


4.8 


1.29 


1.1 


10.6 


117 


13.8 


2.73 


4.9 


26.1 


117 


21.0 


9.89 


6.5 


43.9 


117 


5.3 


4.65 


0.4 


44.5 


117 


5,910 


519.66 


5,121 


10,269 


117 


669 


360.16 


122 


2,204 


117 


6.26 


2.07 


0.90 


15.60 


117 


31.3 


17.54 


0.2 


93.9 


117 


3.1 


2.08 


0.1 


12.4 


117 


1.5 


6.02 


0 


43.6 


117 


1.7 


1.77 


0 


9.1 


117 


62.4 


18.92 


5.6 


98.9 


117 


0.1 


0.14 


0 


1.5 


117 


63.7 


5.30 


45.2 


75.7 


117 


33.5 


4.93 


20.6 


51.0 


117 


2.1 


0.97 


0.5 


6.8 


117 


0.7 


0.38 


0 


4.2 


117 


7.5 


2.13 


1.5 


22.2 



All values weighted by total school district population (public, charter, and private). 

* End-of-Course and End-of Grade exams are percent of students scoring at Level III or higher for the district. 




** North Carolina did not report scores if fewer than 5 students took the exam. Fourteen districts did not report EOC scores for 
their African American populations in 1998-1999. Of the four required subjects (Algebra I, Biology, ELPS and U.S. History), 
the following are the 14 LEAs and the EOC exams not reported for African American students in 1998-1999: Alleghany County 
(Algebra I, Biology, ELSP and U.S. History): Ashe County (Algebra I, Biology, ELSP and U.S. History); Avery County (Algebra I, 
Biology, ELSP and U.S. History); Cherokee County (Biology, ELPS, and U.S. History); Clay County (Algebra I, Biology, ELSP and 
U.S. History): Dare County (ELPS); Graham County (Algebra I, Biology, ELSP and U.S. History); Jackson County (Algebra I, 
Biology, ELSP and U.S. History); Macon County (U.S. History); Madison County (Algebra I, Biology, ELSP and U.S. History): 
Mitchell County (Algebra I, Biology, ELSP and U.S. History); Swain County (Algebra I, Biology, ELSP and U.S. History); 

Watauga County (Algebra I, Biology, ELSP and U.S. History); and Yancey County (Algebra I, Biology, ELSP and U.S. History). 
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Data Appendix 



VARIABLE 


DESCRIPTION 


Catholic Membership 


Percent school district Catholic membership. 
Sources: Roman Catholic Diocese of Charlotte, and 
Roman Catholic Diocese of Raleigh; based on 2000 
Census. 


Public School Enrollment, 1998-1999 


Percent public school students of total district students. 
Total students = sum of public, charter, and private 
enrollment, 1998-1999. 

Source: The North Carolina Statistical Profile, 1999 
www.ncDublicschool.ore/fbs/stats/Ddf/1 999 d 1 .odf 


Charter School Enrollment, 1998-1999 


Percent charter school students of total district students. 
Total students = sum of public, charter, and private 
enrollment, 1998-1999. 

Source: The North Carolina Statistical Profile, 1999 
www.ncpublicschool.ore/fbs/stats/ndf/l 999 d 1 .odf 


Private School Enrollment, 1998-1999 


Percent county private school enrollment of total students. 
Source: State of North Carolina Private School Statistics 
www.doa.state.nc.us/dnpe/hhh548.htm 


Number of Public School Violent Acts, 
per 1000, 1998-1999 


The rate is calculated by dividing the total number of all 
acts committed by total student membership as of June 
1999 and then multiplying by 1000. 

Source: A Report Card for the ABCs of Public Education 
Volume II, 1999-2000: Subgroup Statistics and 
Supplemental Data (NCDPI 2000, pp. 1-193). 
www.ncpublicschools.ore/Accountabilitv/reDorting/reoort 
card/2000/SuDDlementalData.Ddf 


Total Per Pupil Expenditure, and Per Pupil Capital 
Expenditure (5 Year Avg.), 1998-1999 


Per pupil expenditures by school district in thousands of 
dollars, 1998-1999. 

Source: The North Carolina Statistical Profile, 2000 
www.ncpublicschools.ore/fbs/stats/Ddf/2000D2.Ddf 


White, Black, Hispanic, American Indian, and Asian 
Public School Enrollment, 1998-1999 


Percent school district public school enrollment (excludes 
charters, but includes special education enrollment). 
Source: The North Carolina Statistical Profile, 2000 
www.ncDublicschools.ore/fbs/stats/pdf/2000D2.Ddf 


Public School End-of-Course (EOC) Exam Scores: 
Algebra I, Algebra U, Biology, Chemistry, English I, 
English n, ELPS, Geometry, Physical Science, 
Physics, U.S. History and 
Composite, 1998-1999 


Percent of students taking exam scoring at Achievement 
Level III or better. 

Source: A Report Card for the ABCs of Public Education 
Volume II 1998-99: End-of-Course Subgroup Statistics by 
School System 

www.ncDublicschools.ore/Accountabilitv/reDorting/reDort 
card/1 999/index.html 


Public School End-of-Grade (EOG) Exam Scores: 
3rd - 8th Reading, 3rd - 8th Mathematics, 

4th & 7th Writing, and 
Composite, 1998-1999 


Percent of students taking exam scoring at Achievement 
Level III or better. 

Source: A Report Card for the ABCs of Public Education 
Volume II 1998-99: End-of-Course Subgroup Statistics by 
School System 

www.ncDublicschools.org/Accountabilitv/reDortine/reDort 
card/ 1 999/index.html 


Average Test Score of Four Required 
EOC Subject Exams, 1998-1999 


The four required subjects for all students are: Algebra I, 
biology, ELPS, and U.S. History for the 1998-1999 
academic year. This variable is the average of the four 
test scores = ((Algebra I + biology + ELPS + U.S. 
History )/4). 

Source: Variable generated by the author. 
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VARIABLE 


DESCRIPTION 


Public School Dropout Data, 1998-1999: Grades 9th - 
12th Duplicated Dropouts 


A dropout is a student who leaves school before 
graduation or completion of a program for any reason 
except death or transfer. Beginning in the 1998-‘99 
academic year, the NC Board of Education began 
reporting the duplicated number, which records all 
dropouts regardless if they have been previously recorded. 
The figures include charter dropouts. 

Source: The North Carolina Statistical Profile, 2000 
www.ncDublicschools.ore/fbs/stats/Ddf/2000o2.Ddf 


Highest Degree Held by Instructional Personnel and 
Teachers with No Prior Experience 


Percent of teachers by school district. Instructional 
personnel include: all professional educators with direct 
instructional responsibility such as principles, teachers, 
librarians, guidance counselors, and supervisors of 
instruction (p. 33). 

Source: The North Carolina Statistical Profile, 1999 
www.ncDublicschools.ore/fbs/stats/Ddf/1999D2.Ddf 


Parent Education Level of Student’s Taking EOG 
Exams, 1998-1999: Did Not Finish High School; 
High School Graduate; Trade/Business School; 
Community College; Four Year College; 
and Graduate School 


The percent of students taking the EOG exam with 
parents of corresponding education level, by LEA 
Source: North Carolina Department of Public Instruction, 
non-published information. 


Children Age 5-17 in Poverty in 1997 


Percent of school aged children (5-17) related to the head 
of household and below the poverty line by school district 
in 1997. 

Source: U.S. Census SAIPE School District Estimates, 
1997 

www.census.gov/hhes/www/saiDe/schooi/sd97ftDdoc.html 


Median Household Income 


Median household dollar income by school district. 
Figures are U.S. Census 1997 model-based estimates. 
Source: 2000 U.S, Census 
www.Quickfacts.census.gOv/afd/states/3 7000.html 


Adults over 25 with College Degree, 1990 


County percent adults over 25 with college degree in 
1990, listed by school district. 

Source: North Carolina Dept, of Commerce, 2000 County 
and Regional Scans 

www.commerce.state.nc.us/econscan/countv.asD 


Population Density 


County measure of population per square mile in 2000, 
listed by school district. 

Source: North Carolina Dept, of Commerce, 2000 County 
and Regional Scans 

www.commerce.state.nc.us/econscan/countv.asD 
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